conservative leader was speaking from autocue at croydon election event .
but tory party confirmed it was an ` off the cuff ' remark not in his speech .
got the wrong claret and blue side despite being a villa fan since his teens .
said in his defence : ` these things can happen when you are on the stump '